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A  Story... 

Program  goal:  provide  a  tool  for  strategic,  operational,  and  tactical 
planners  from  all  services  and  defense  agencies  to  support  joint  and 
coalition  engagements  and  peace  keeping  efforts 

•  Run  on  existing  enterprise  backbone  (managed  by  another  agency) 

•  Interface  with  multiple  existing  and  developing  systems 

•  Operate  across  multiple  security  levels 


Program  Start  (late  ’90s) 

2003 

•Automate  manual  process 

•  New  planning  processes 

•  Client-server  architecture 

•Web-based  architecture 

•  Support  2-3  day  planning  cycle 

•  Dynamic  planning  cycles 
•Collaborative  planning 

6  increments  delivered  across  6-7 

•Increment  1  is  obsolete 

years 

•Struggling  to  build/field  increment  2 

•  First  release  in  18-24  months 

•  Users  have  built  “interim”  solutions 
•Future  is  uncertain 
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Size  Matters! 


Project  Size 

People 

Time 

(mos) 

Success 

Rate 

<  $750K 

6 

6 

55% 

$750K-$1.5M 

12 

9 

33% 

$1.5M-$3M 

25 

12 

25% 

$3M-$6M 

40 

18 

15% 

$6M-$10M 

+250 

+24 

8% 

>$10M 

+500 

+36 

0% 

Source:The  Standish  Group,  1999 
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Definitions 

A  software-intensive  system  is  one  that 

•  Relies  on  software  to  provide  core/priority  mission 
function(s) 

A  large  software-intensive  system  is  one  whose  software 

•  Takes  longer  than  6  months  to  implement 

•  Takes  more  than  6  people  to  implement 

•  Takes  more  that  $750,000  to  implement 
and/or 

•  Is  comprised  of  multiple  interrelated  systems  or 
independently  developed  components  implemented  in 
software  (system  of  systems,  family  of  systems,  etc) 
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Outline 

Change  Happens 


Adapting  to  Change 


Be  Ready  to  Change  Quickly 
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Change  Happens 

Large  software-intensive  systems  change  at  a  rate  faster 
than  the  full  system  capability  can  be  implemented  -  and 
they  change  during  development  and  operation 

Sources  of  change 

•  Enterprise  priorities  shift 

•  Business  or  operational  needs  change 

•  New  technologies  introduce  new  opportunities 

•  COTS  products  add  and  delete  key  features 

•  Participants  rotate 
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Adapt  to  Change 

DoD  5000*  provides  mechanisms  for  coping  with  change 


Evolutionary  Acquisition 

Delivers  capability  in  increments, 
recognizing,  up  front,  the  need  for 
future  capability  improvements 

•  Success  of  the  strategy  depends  on 
the  consistent  and  continuous 
definition  of  requirements  and 
maturation  of  technologies  that  lead 
to  disciplined  development  and 
production  of  systems  that  provide 
increasing  capability  towards  a 
material  concept. 


Spiral  Development 

A  desired  capability  is  identified  but 
the  end-state  requirements  are  not 
known  at  program  initiation 

•  Those  requirements  are  refined 
through  demonstration  and  risk 
management;  there  is  continuous 
user  feedback;  and  each  increment 
provides  the  user  the  best  possible 
capability.  The  requirements  for 
future  increments  depend  on 
feedback  from  users  and  technology 
maturation. 


The  Operation  of  the  Defense  Acquisition  System,  30  Oct  02 
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Lessons  Learned 


Going  after  “low  hanging  fruit”  in  the  absence  of  an 
overarching  architecture  and  coherent  plan  results  in 
incompatible  and  stove-piped  solutions 


System  requirements  defined  without  sufficient  insight  into 
what  can  be  realistically  built,  results  in  systems  that  cannot 
be  built 


There  are  no  “silver  bullets”  that  avoid  disciplined  system 
and  software  engineering  (doing  the  right  engineering 
correctly) 
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Be  Ready  To  Change  Quickly 

Consciously  apply  spiral  development  practices  at  2  (or 
more)  discrete  levels  -  with  continuous  interaction  between 
the  levels 

•  Program  or  system  level 

-  Evolve  definition  and  implementation  plan  for  system 
end-state 

-  Define  and  spawn  increments  of  useful  capability  that 
will  build  to  full  system  functionality  and  performance 

•  Project  or  increment  level 

-  Define  and  implement  plan  for  delivering  the  defined 
increment  in  the  context  of  the  system  end-state 
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Disciplined  Spiral  Development 


Time 


0 


Continuously  determine  a 
compatible  and  feasible  set  of: 

business  processes,  requirements,  plans,  architecture, 
COTS  products  and  other  components 


Enterprise  business  objectives  drive  solution  definition 

Risk  considerations  drive  degree  of  detail 

Executable  representations  demonstrate  current  understanding 
and  agreements 

Spiral  development  facilitates  evolving  a  viable  solution  - 
at  both  system  and  increment  levels 
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Phases  Bounded  by  Anchor  Points 


LifeCyde 

LifeCyde 

Initial 

Objectives 

Architecture 

Operational 

Capability 


CotnMerging 


decisions 


Scope 


Hmitercfen 

v.. 


y  $ 

IM 


Design 


A. 

* 


. . .  $ 


Build 


Dl 

,  * 
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Field 


A 

* 


Multiple  iterations  per  phase 
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Disciplines*  Extend  Across  Phases 


Scope 


rbeinn 


Ri  lilrl 


Reid 


Business  modeling 
Requirements 

Analysis  &  design 

Market  research 

Implementation 

Test 

Project  management 


^adapted  from  Kruchten;  shows  partial  set  of  disciplines 
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Keep  a  Long  View  in  Systems  Planning 


Reprinted  through  the  courtesy  of  CIO 
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Evolving  System  Definition 
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Take  a  Short  View  on  Increment  Planning 


Reprinted  through  the  courtesy  of  CIO 
©  2002  CXO  Media  Inc. 

Allows  a  stable  development  environment  -  if  a  short  timeframe 
(6-18  months) 

Allows  focused  discovery,  experimenting,  and  learning  on  a 
manageable  scale  to  find  optimum  way  to  understand  and  meet 
user  needs 
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Increment  Activity  Mapping 


Scope 

Define  feasible 
scope 

Surveyltry 

components 

Agree  to  business 
changes 

Establish  project  plan 
Develop  business  case 

Outline  candidate 
architectures 

Study  COTS  market; 
screen  candidates 

Prepare  demos  of 
candidate  solutions 

Identify  key  risks 

Determine  business 
changes 


Design 

Refine,  experiment, 

&  select  solution 

Trylselect 

components 

Prototype  business 
changes 

Update  project  plan 

Define,  baseline  and 
demonstrate  solution 

Evaluate  COTS  products 
and  components 

Stabilize  requirements  and 
architecture 

Develop  plan  to  manage 
business  process  change 


Build 

Implement  selected 
solution 

Applyltrack 

components 

Prepare  to  change 
business  processes 

Update  project  plan 

Build  production  quality 
solution  for  beta  test 

Continue  market/COTS 
surveys  and  evaluation 

Prepare  end  users  for 
initial  fielding 


Field 

Rollout  and 
support  solution 

Useltrack 

components 

Change  business 
processes 

Complete  rollout 

Fix  bugs,  adjust 
features,  make  minor 
enhancements 

Achieve  user  satisfaction 
/  self-supportability 

Continue  market/COTS 
surveys  and  evaluation 

Support  solution  until 
retirement 
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Leverage  Feedback  between  Long-  and 
Short-Term 

Maintain  long-term  strategy 
(system  level)  aligned  with 
enterprise  improvement 

Make  short-term 
implementation  decisions 
(increment  level)  aligned  with 
long-term  strategy 

Use  knowledge  gained  in  short¬ 
term  increments  to  evolve  long¬ 
term  strategy 

Reprinted  through  the  courtesy  of  CIO 
©  2002  CXO  Media  Inc. 

Anticipate  continuous  change 


©  2003  by  Carnegie  Mellon  University 


26  January  2003 


page  18 


Carnegie  Mellon 

Software  Engineering  Institute 


Plan  and  Manage  Efficient  Feedback 


planning  and 
enactment 


initial  scope 


planning  and 
enactment 


evaluation  in  context  of  system 
scenarios 


updated ' 
requirements, 
architecture 

refined  scope, 
requirement, 
architecture 
adjustments 


System  Level 


evaluated 

increment 

scenarios 


analyzed  in  context  of  increment 
level  scenarios 


Increment  Level 


Decisions  take  place  simultaneously  at  both  levels  - 

one  informs  the  other 
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Managing  Continuous  Evolution 


System  level 


Scope 

Design 

Scope 

Design 

•  Business 
model 

•  Scope 

•  Constraints 

•  Market  study 

•  Critical  use  cases  at 
system  level  (what) 

•  Architecture  (how) 

•  Available  and 
projected  technology 

•  Business 
model 

•  Scope 

■  ■  ■  •  Constraints 

•  Market  study 

•  Critical  use  cases  at 
system  level  (what) 

•  Architecture  (how) 

•  Available  and 
projected  technology 

LCO 

LCA 

LCO 

LCA 

i 


i 


it  ti 


Increment  #1 
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Scenarios  of  Multiple  Increments 


System  level 


Scope 


Design 


LCO 


LCA 


Several  increments  for  same  area  of 
system  capability  where  successive 
generations  provide  greater  capability 


I 


Several 
increments  for 
different  areas 
of  system 
capability 
running 
concurrently 


< 


Increment  #n 


Scope 

Design 

Build 

Field 

LCO  LCA 


IOC 


6-18  months 


Increment  #n 


Scope 

Design 

Build 

Field 

LCO  LCA 


IOC 


6-18  months 


V 
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The  Handwriting  on  the  Wall 

Change  Happens 

Adapt  To  Change  Quickly 

•  Anticipate  Change 

•  Monitor  Change 

•  Change 

•  Enjoy  Change! 

Be  Ready  To  Change  Quickly 
And  Enjoy  It  Again 
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Contact  Information 


Lisa  Brownsword 
llb@sei.cmu.edu 


Cecilia  Albert 
cca@sei.cmu.edu 
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Lisa  Brownsword  is  a  senior  member 
of  the  technical  staff  in  the  Commercial- 
off-the-shelf-  (COTS)-Based  Systems 
(CBS)  Initiative  at  the  Software 
Engineering  Institute  (SEI).  Before 
joining  the  SEI,  Lisa  was  on  staff  at 
Computer  Sciences  Corporation  in 
support  of  NASA/Goddard’s  Software 
Engineering  Lab.  Prior  to  that,  she  was 
employed  at  Rational  Software 
Corporation  providing  consulting  to 
managers  and  technical  practitioners  in 
the  use  of  and  transition  to  software 
engineering  practices,  including 
architecture-centered  development, 
product  lines,  object  technology,  Ada, 
and  CASE. 
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